Skip to content

Conversation

andrewheard
Copy link
Contributor

@andrewheard andrewheard commented Nov 7, 2024

The Vertex AI backend now includes the responseSchema (from GenerationConfig; see #13813) in token counts. Although there are no SDK changes, I've added a changelog entry to describe the difference.

@andrewheard andrewheard requested a review from paulb777 November 7, 2024 21:56
@andrewheard andrewheard marked this pull request as ready for review November 7, 2024 21:57
@andrewheard andrewheard merged commit 32a6788 into main Nov 7, 2024
38 checks passed
@andrewheard andrewheard deleted the ah/vertex-integration-fix branch November 7, 2024 22:30
@firebase firebase locked and limited conversation to collaborators Dec 8, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants